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Page J? 1 st column, lines 1-14 
[CLAIMS] 

[Claim 1] A system for processing information comprising: 

a fetching means for fetching identification information to identify objects in a real world; a 
storage means for storing certain information; and a processing means for selecting 
information relating to the identification information fetched with the fetching means from 
memory information stored in the storing means, and processing the selected information. 
[Claim 2] The system for processing information according to claim 1, further comprising an 
output means for outputting information processed with the processing means. 
[Claim 3] The system for processing information according to claim 1, wherein the fetching 
means is either a video camera or a bar code reader. 

Page 3, 4 th column, line 16 to page 4, column 5, line 5 
[0019] FIG. 1 illustrates an example of a typical configuration of an information processing 
system according to the present invention. In this embodiment, a portable terminal 10 
comprises an input part 1 so as to fetch data of a real world object 13. The input part 1 
comprises a CCD vide camera, a bar code reader, a microphone and the like. The real world 
object 13 can be selected from various things such as a table, a cabinet, a door, a wall, a 
computer, office equipment, a document, and a holder. 

[0020] A detection part 2 is composed of a GPS device and a PHS device (handy radio 
telephone) or the like. It receives radio waves transmitted by means of a satellite or the like so 
as to detect a present time and present location. 

[0021] An input part 3 is composed of a keyboard, a trackball or the like, and it is operated to 
input user ID or any other data. 

[0022] A synthesis part 4 synthesizes data of the real world object 13 fed from the input part 1, 
time data and location data fed from the detection part 2, and data including user ID fed from 
the input part 3, and feeds the synthesized data to the communication part 6. The 
communication part 6 outputs the inputted data to a network 11 and also fetches data 
transmitted from the network 11 so as to output to an output part 5 composed of a display, a 
speaker or the like. 
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[0023] The network 11 can be wireless or composed of through a certain communication 
circuit, and it is connected to a data base 12. 

[0024] The following is a description about the operation. The communication part 6 reads an 
identification code (ID) of a certain portion of the real world object 13 from the input part 1 by 
using a CCD video camera. The read-out identification data is feeds to the communication 
part 6 through the synthesis part 4. The communication part6 6 fed the data to the data base 12 
through the network 11. 

[0025] The data base 12 makes a search corresponding to the inputted identification code, and 
outputs the obtained search result to the communication part 6 through the network 11. The 
communication part 6 feeds the data to the output part 5. Image data is indicated on a display 
while voice data is outputted from a speaker. 
[FIG. 1] 
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(54) SYSTEM AND METHOD FOR PROCESSING 
INFORMATION 

(57) Abstract: 

PURPOSE: To easily and speedily process data. 

CONSTITUTION: A color code 42 of a book 41 is fetched 
by a CCD video camera 31 and this is identified by a 
color code identifying part 61. When recognition a voice 
fetched by a microphone 32, at a voice recognition part 
62, the dictionary of a field corresponding to the color 
code 42 identified by the color code identifying part 61 
is selected out of plural dictionaries, which are 
provided for an interactive dictionary 63, and referred to. 
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